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The  potential  of  an  optical  Fourier  technique  for  measuring  the  optical 
distortion  of  aircraft  windscreens  was  examined.  It  was  hypothesized  that 
the  compactness  of  the  harmonics  of  the  optical  Fourier  transforms  of  vertical 
and  horizontal  square  wave  targets  photographed  th* Jugh  windscreens  would 
correlate  highly  with  distortion  in  photographs  of  a  gridboard.  Eleven 
transparent  optical  distortion  panels  were  used  to  produce  gridboard  pictures 
and  vertical  and  horizontal  transform  pictures.  Gridboard  pictures  were  sub¬ 
jectively  ranked  by  23  obeervers  for  amount  of  optical  distortion. Q  (continued/ 
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Transform  pictures  were  ranked  for  compactness  of  the  third  harmonic.  All 
three  picture  sets  were  also  measured  by  subjective  magnitude  estimation. 

Rank  correlation  between  gridboard  photograph  distortion  ranks  and  compactness 
ranks  for  the  vertical  Fourier  transform  was  .950.  Overall  rankings  of 
gridboard  distortion  photographs  and  compactness  rankings  was  .977.  Such  high 
statistically  significant  correlations  show  that  distortion  judgements  from 
gridboard  photographs  is  accurately  predictable  from  judged  compactness  of  the 
third  harmonic.  Thus,  the  Fourier  method  may  be  useful  for  measuring  optical 
distortion.  Development  of  objective  methods  to  measure  the  compactness  and 
to  calibrate  such  measures  against  conventional  measurements  is  warranted. 

This  development  would  lead  to  a  rapid,  accurate  and  objective  method  for 
measuring  the  optical  distortion  of  aircraft  windscreens. 
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PREFACE 


This  report  was  prepared  in  the  Human  Engineering  Division  of  the  Aerospace  Medical  Research  Laboratory,  Wright* 
Patterson  Air  Force  Base,  Ohio.  The  work  was  performed  under  Project  7184,  Man-Machine  Integration  Technology,  Task 
18,  Visual  Effects  of  Windscreens  on  Pilot  Performance,  and  Work  Unit  03,  Visual  Perception  Through  Windscreens.  This 
work  supports  the  Improved  Windscreen  Protection  Development  Program,  Projects  2202  and  1926  of  the  Air  Force  Flight 
Dynamics  Laboratory,  Wright-Patterson  Air  Force  Base,  Ohio. 

The  authors  thank  Mr.  Mike  Pool  and  Mr.  Allen  Pinkus  for  constructing  the  light  box  for  the  targets,  constructing  the 
target  patterns  and  doing  the  photography. 


[  Aeotssion  Fop  ~f 

NTIS  GRAM 

* 

DTIC  TAB 

n 

Unannounced 

□ 

Justification. 

Btr  _ -j 

Di  stribution/ 

Aval lab1 llty 

Codes 

nnd/or 

iDist  1  Special 


1 


TABLE  OF  CONTENTS 

P 

INTRODUCTION . 

METHODS  OF  MEASURING  DISTORTION 

Grid  Line  Scope . 

Leasing . 

Displacement  Grade . 

Comments  on  Leasing  and  Displacement  Grade  Measures . 

OPTICAL  FOURIER  ANALYSIS . 

EXPERIMENT  1 . 

Method:  Experiment  1 . 

Results:  Experiment  1 . 

EXPERIMENT  2 . 

Results:  Experiment  2 . 

CONCLUSIONS  FROM  EXPERIMENTS  1  AND  2 . 

APPENDIX  I,  INSTRUCTIONS  FOR  EXPERIMENT  2 

APPENDIX  II,  COMMENTS  ON  FOURIER  ANALYSIS 

REFERENCES . 


LIST  OF  ILLUSTRATIONS 

Figure 

1  Photographing  Geometry  for  Grid  Line  Slope  Measurements . 

2  Optical  Fourier  Transform  Device . 

3  Photograph  of  Vertical  Line  Target  with  No  Intervening  Transparency  (top)  and 

Fourier  Transform  of  the  Photograph  (bottom) . 

4  Photograph  of  Vertical  Line  Target  with  a  High  Distortion  Transparent  Panel  (no.  1 1) 

Intervening  Between  Camera  and  Target . 

5  Gridboard  Photograph  Taken  Through  a  Low  Distortion  Transparent  Panel . 

6  Gridboard  Photograph  Taken  Through  a  High  Distortion  T ransparent  Panel . 

7  Fourier  Picture  Using  a  Target  with  Horizontal  Lines  and  the  Same  Low  Distortion 

Transparent  Panel  used  in  Making  Figure  5 . 

8  Fourier  Picture  Using  a  Target  with  Vertical  Lines  and  the  Same  High  Distortion 

Transparent  Panel  used  in  Making  Figure  6 . 

9  Plots  of  Gridboard  Distortion  Rankings  Against  Compactness  Rankings  of  the  Horizontal 

and  Vertical  Fourier  Third  Harmonic  Pictures . 

10  Distortion  Ranks  of  Gridboard  Photographs  Plotted  Against  Compactness  Ranks  of  Horizontal 

Fourier  Pictures  with  Picture  “8”  Omitted . 


2 


INTRODUCTION 


Aircraft  windscreens  are  optical  devices  through  which  the  pilot  observes  the  environment  outside  the  aircraft  As  aircraft 
speeds  have  increased  and  operational  altitudes  have  been  lowered  to  several  hundred  feet  above  the  ground,  the  impact 
on  aircraft  windscreens  has  been  significant.  The  windscreens  have  been  designed  as  smoothly  curved  surfaces  installed  at 
extremely  slanted  angles  to  reduce  aerodynamic  drag  and  improve  operational  performance.  Because  of  the  lower  operating 
altitudes,  the  probability  of  an  aircraft  colliding  with  birds  has  increased.  The  windscreens  are  therefore  designed  to  be 
thick  enough,  and  the  material  they  are  made  of  tough  enough,  to  withstand  these  impacts  with  birds,  usually  called  “bird 
strikes.”  The  result  of  these  evolutionary  changes  is  that  the  windscreens  are  being  designed  as  thick,  curved  sections  of 
multilayered  plastic  to  achieve  the  desired  aerodynamic  and  bird  strike  resistant  characteristcs.  This  has  recently  led  to  in¬ 
creased  concern  about  the  see-through  optical  distortion  quality  of  the  windscreens. 

Optical  distortion  assumes  many  forms,  such  as  magnification  which  varies  from  point  to  point  on  the  windscreen,  images 
optically  displaced  by  variable  amounts  and  variable  directions  from  point  to  point  in  the  field  of  view,  etc.  In  non- 
quantitative  terms,  a  windscreen  (or  any  transparency)  is  said  to  have  distortion  if  a  straight  line  target  pattern  appears 
curved  or  wavy  when  viewed  through  the  transparency.  The  basic  problem  is  to  define  this  effect  in  such  a  way  that  it  may 
be  quantified  and  measured.  Probably  the  most  widely  used  definition  of  distortion  (for  aircraft  windscreens)  is  “distortion 
is  the  rate  of  change  of  deviation”  (Thompson;  1970),  (Grether;  1973).  However,  it  has  also  been  defined  as  “...a 
nonuniform  rate  of  change  of  deviation...”  (Cocagne  &  Blome;  1968).  In  each  of  these,  deviation  is  defined  as  the  angular 
change  that  a  light  ray  undergoes  in  passing  through  the  transparency. 

Distortion  has  also  been  categorized  into  loosely  defined  types  such  as  banding,  sharp  bending,  blurring,  bull’s  eyes,  con¬ 
verge  nc),  magnification  and  rolling  (Thompson;  1970,  Self;  1976).  An  attempt  at  defining  distortion  in  terms  that  could  be 
used  for  accepting  or  rejecting  aircraft  windscreens  was  made  by  Thompson  (1970)  in  conjunction  with  the  F-lll  glass 
windscreens. 

The  problem  is  to  devise  a  relatively  rapid  and  accurate  method  to  measure  the  quantitatively  defined  parameter  of  distor¬ 
tion.  This  might  be  done  by  a  direct  method  or  by  a  measure  that  indirectly  represents  the  effects  of  distortion.  A  second 
very  important  aspect  of  the  problem,  in  either  case,  is  to  validate  any  direct  or  derived  measurements  by  comparisons  with 
(1)  judgments  of  distortion  in  the  same  windscreens  by  human  observers  or  (2)  conventional  measurement  methods.  This 
must  be  done  in  such  a  way  that  limits  on  the  measured  parameters  can  be  set  for  acceptance  or  rejection  of  the  wind¬ 
screen.  This  problem  is  compounded  by  parameter  value  changes  of  most  measures  with  changes  in  viewing  position  and 
field  angle. 
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METHODS  OF  MEASURING  DISTORTION 


Moat  methods  of  measurement  currently  in  use  require  that  a  photograph  be  taken  through  the  windscreen  of  a  large,  high 
contrast  target  pattern  made  up  of  a  rectilinear  matrix  of  one  inch  squares,  using  line  widths  of  either  1/32  or  1/16  inch. 
These  target  patterns  are  usually  made  by  constructing  a  string  board  with  numerous  horizontally  and  vertically  oriented 
strings  spaced  one  inch  apart  A  variation  of  this  is  to  use  a  spacing  of  inch  as  a  means  of  improving  the  sensitivity  of 
the  distortion  measurements.  The  influence  of  gridboard  line  width  and  spacing  on  windscreen  distortion  measurements  is 
discussed  by  Seid  and  Self  (1978).  Similar  target  patterns  have  also  been  constructed  using  photographic  transparencies  or 
painted  grid  masks  on  glass  or  clear  plastic  in  front  of  a  source  of  back  illumination  in  a  light  box.  The  most  widely  used 
target  has  white  lines  against  a  dark  background,  although  some  have  been  built  with  a  reverse  polarity. 

GRID  LINE  SLOPE 

This  measurement  is  probably  now  the  most  popular.  A  photograph  is  taken  of  the  target  board  through  the  windscreen.  The 
camera  is  located  at  the  design  eye  position  of  the  windscreen  (Douglas  Report;  1975)  or  at  some  other  designated  distance  from 
the  windscreen  (ASTM;  1976).  The  windscreen  distance  from  the  target  gridboard  is  determined  by  the  specific  desires  of  those 
requiring  the  test.  It  is  sometimes  determined  by  the  size  of  the  room  available  for  testing.  The  effects  of  variation  in  these 
distances  on  gridboard  magnification  produced  by  windscreen  focusing  power  are  analyzed  by  Seid  and  Self  (1978).  Figure  1 
shows  the  photographing  geometry.  Care  is  taken  to  insure  that  the  film  plane  of  the  camera  is  parallel  to  the  plane  of  the  grid- 
board.  Also,  a  low  distortion  lens  is  required  for  the  camera,  and  later,  for  the  photographic  enlarger  that  makes  the  large  prints. 
The  resulting  photograph  is  enlarged,  usually  to  8  by  10  inches,  for  measurement.  The  photographic  enlargement  or  print  is 
then  placed  on  a  drafting  board  and  aligned  so  that  some  of  the  horizontal  grid  lines  recorded  around  and  outside  the  edge  of 
the  windscreen  are  accurately  horizontal  on  the  table.  These  lines  are  not  distorted  by  the  windscreen,  and  therefore  may  be 
used  as  a  baseline  reference.  Once  the  photograph  has  been  aligned,  it  is  firmly  fixed  to  the  table  with  masking  tape.  Then  a 
drafting  square  is  used  to  determine  the  magnitude  of  the  slope  of  any  lines  that  deviate  from  perfectly  vertical  or  perfectly 
horizontal.  The  photograph  is  measured  in  several  areas  to  determine  the  maximum  slope.  The  slope  is  usually  given  as  a  ratio, 
such  as  1  in  20  or  1  in  10,  which  is  the  tangent  of  the  angle  between  the  horizontal  or  vertical,  whichever  is  being  measured,  and 
the  straight  lines  showing  at  the  sides  of  the  picture.  Table  1  compares  different  distances  and  units  that  have  been  used  or 
proposed  by  different  organizations. 


Figure  1.  Photographing  Geometry  for  Grid  Line  Slope  Measurements. 


LENSINQ  (Thompson;  1970) 

Lensing  measurements  are  made  from  the  same  8  by  10  inch  photographic  enlargements  described  in  the  preceding  section.  A 
section  of  the  gridboard  that  appears  in  the  photograph,  but  which  was  not  photographed  through  the  windscreen,  is  used  as  a 
baseline.  The  number  of  grid  squares  per  inch  that  appear  in  this  portion  of  the  photograph  is  determined  (typically  13  to  14 
squares  per  inch).  Then  the  number  of  squares  in  one  inch  sample  lengths,  as  photographed  through  the  windscreen,  is 
measured  for  several  positions  in  the  windscreen  (both  in  the  vertical  and  horizontal  directions).  The  smaller  of  these  two 
numbers  is  divided  into  the  larger,  producing  a  number  larger  than  unity.  This  number,  when  cubed  to  “spread  the  numbers 
out,”  is  called  the  “lens  factor”  (Thompson;  1970). 


TABLE  1 


COMPARISON  OF  DISTANCES  AND  GRID  BOARD  SQUARE  SIZES 
PROPOSED  OR  USED  BY  DIFFERENT  ORGANIZATIONS + 


Organisation 

Sue  of 

Squares 

D, 

D, 

Units  of 

Distortion 

ASTM  1 

1.8  cm 

450  cm 

550  cm 

mrad/cm 

ASTM  II 

lJJ  cm 

300c» 

ISO  cm 

mrad/cst 

Douglas 

1  inch 

Design 

15  feet 

Ratio: 

Ey« 

(1  in  10) 

USAF/AFSCDH-21 

Min/inch 

McDonnell  Company 

1  inch 

3  feel 

15  feel 

PPG 

1  inch 

Ratio 

Lockheed 

1  inch 

Vi  inch 

Swedlow 

1  inch 

Sierracia 

1  inch 

General  Dynamics 

I  inch 

Ratio 

AFAMRL 

1  inch 

Design 

15  feel 

tyc 

USAFSAM 

1  inch 

Design 

Ratio 

E,' 

♦  Refer  lo  Figure  i  for  meaning  of  D,  and  Dr 


DISPLACEMENT  GRADE  (Thompson;  1970) 

Displacement  grade  is  also  measured  on  the  8  by  10  inch  gridboard  photographs  previously  described.  For  the  area  of  the  wind¬ 
screen  to  be  measured,  tKe  maximum  vertical  displacement  of  any  horizontal  grid  line  is  measured  on  the  photograph  in  hun¬ 
dredths  of  an  inch.  This  value  is  added  to  the  maximum  horizontal  displacement  of  any  vertical  grid  line.  The  sum  is  then 
multiplied  by  1000  to  arrive  at  the  “displacement  grade**  value  of  the  windscreen  for  the  area  measured. 

COMMENTS  ON  LENSING  AND  DISPLACEMENT  GRADE  MEASUREMENTS 

Usually,  the  windscreen  inspectors  search  for  and  measure  the  maximum  magnification  and  displacement  variation  areas,  and  do 
not  “map”  the  entire  windscreen.  This  is  because  windscreen  procurement  specifications  usually  specify  only  maximum  values 
which  must  not  be  exceeded.  The  conventional  measurements  of  lensing  and  displacement  grade,  as  described  above,  are  made 
from  gridboard  photographs.  Measurement  is  tedious,  even  when  only  maximum  distortions  are  measured.  Many  measurements 
must  be  made  to  find  the  maximums.  It  is  not  surprising  that  different  inspectors,  even  using  the  same  procedures,  may  differ 
appreciably  in  their  measured  distortion  values.  These  measurement  procedures  have  not  produced  an  acceptable  method  of 
determining  and  quantifying  distortion  in  aircraft  windscreens.  They  are  used  despite  their  shortcomings,  because  better  techni¬ 
ques  are  not  available. 


OPTICAL  FOURIER  ANALYSIS 

An  alternative  to  the  windscreen  optical  defect  measurement  methods  discussed  above  is  an  optical  Fourier  analysis  technique.  A 
short  discussion  of  Fourier  analysis  for  the  uninitiated  is  given  in  Appendix  II.  The  method,  as  applied  to  windscreens,  was  devis¬ 
ed  to  simultaneously  measure  the  defects  of  the  whole  windscreen,  or  at  least  large  areas  of  it.  The  application  of  this  method  to 
windscreens  was  developed  by  Dr.  H.L.  Task  (AFAMRL)  who  submitted  it  as  an  Air  Force  Invention  Disclosure  (Number 
13,1648).  A  patent  is  now  pending  on  his  patent  application  filed  on  October  26, 1979  under  the  title  “Measurement  of  Wind¬ 
screen  Distortion  Using  Optical  Diffraction.”  In  the  Fourier  analysis  method,  as  used  in  the  present  report,  a  large  (6  by  6  foot) 
square-wave  target  consisting  of  alternating  parallel  V*  inch  black  and  white  strips  is  photographed  with  a  35  mm  camera 
through  the  windscreen  from  the  design  eye  position  of  the  pilot.  The  resulting  35  mm  slide  is  then  optically  Fourier  transform¬ 
ed,  using  the  laser  and  lens  arrangement  shown  in  figure  2.  This  optical  transform  picture  is  then  compared  to  the  transform  of  a 
photograph  of  the  target  pattern  taken  without  the  windscreen  in  place.  Figure  3  and  4  show  the  target  and  its  transform  without 
windscreen  (figure  3)  and  with  a  distorting  windscreen  (figure  4).  If,  as  will  be  shown  in  this  report,  the  method  is  valid,  then  the 
growth  in  spot  sizes  of  the  transformed  images  can  be  directly  related  to  grid  line  slope  (growth  in  tangential  direction)  and 
magnification  (change  in  radial  direction  of  position  or  size).  The  size  of  the  optical  Fourier  transform  photograph  should  in¬ 
crease  with  increase  in  the  amount  of  visually  perceived  distortion.  Measuring  the  size  of  the  spots  or  the  amount  of  smear  of 
harmonics  to  quantify  the  amount  of  distortion  in  the  windscreen  could  be  done  in  many  possible  ways.  For  example,  the  area  in 
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Figure  2.  Optical  Fourier  Transform  Device 


the  Fourier  space  representing  a  given  harmonic  could  be  scanned  by  a  small  aperture,  dividing  it  into  many  smail  squares.  The 
number  of  small  squares  whose  energy  content  exceeded  some  preset  minimum  would  be  an  objective  estimate  of  the  optical 
distortion  of  the  windscreen.  An  objective  scoring  method  for  measuring  the  smear  would  be  highly  desirable.  However,  the 
equipment  and  technique  are  yet  to  be  developed.  Before  the  development  effort  is  expended,  it  is  reasonable  to  determine  if 
the  effort  would  be  worthwhile.  To  examine  this  question,  one  determines  if  an  optical  Fourier  analysis  method  would  or  could 
yield  results  in  line  with  visual  estimates  of  optical  distortion  made  by  examination  of  gridboard  photographs  taken  through 
windscreens.  This  can  be  done  by  subjective  scoring. 

The  scoring  is  based  on  judgments  of  pictures.  One  starts  by  inserting  a  series  of  windscreens,  one  at  a  time,  between  the  camera 
and  the  gridboard,  and  taking  a  picture  through  each  windscreen.  The  pictures  are  enlarged  to  make  a  glossy  photographic 
print.  Also,  pictures  are  taken  using  a  parallel  line  target  rather  than  a  gridboard,  first  with  horizontal  lines  then  with  vertical 
lines.  These  pictures  are  placed  in  the  Fourier  apparatus  and  a  piece  of  film  exposed  in  the  Fourier  plane,  developed  and  enlarg¬ 
ed  into  glossy  photographic  prints.  Observers  rank  the  gridboard  pictures  according  to  how  much  distortion  of  the  gridboard 
lines  appear  to  be  present  The  two  sets  of  Fourier  analysis  pictures  are  ranked  according  to  the  amount  of  spreading  or  smear¬ 
ing  of  the  third  harmonic  '‘spot,”  yielding  separate  vertical  and  horizontal  rankings.  Each  set  of  pictures  is  kept  separate  and 
thoroughly  mixed  independently  and  randomly  for  each  observer  so  that  observers  do  not  know  which  Fourier  picture  cor¬ 
responded  to  which  gridboard  picture.  This  procedure  yields  average  rankings  for  each  windscreen  gridboard  picture  and  each 
Fourier  transform  picture. 

The  size  of  the  rank  correlation  coefficients  between  the  gridboard  ratings  and  the  vertical  and  horizontal  smearing  ratings  in¬ 
dicates  how  well  the  Fourier  analysis  technique  predicts  gridboard  rankings.  High  correlations  will  indicate  that  the  Fourier 
method  can  replace  a  gridboard  picture  method  and  that  further  research  should  be  done  to  develop  an  objective  method  of 
scoring  (or  measuring)  the  amount  of  spreading  of  the  second  harmonic  or  some  combination  of  harmonics. 


Figure  3.  Photograph  of  Vertical  Line  Target  With  No  Intervening  Transparency  (top)  and  Fourier  Transform  of  the 
Photograph  (bottom). 
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EXPERIMENT  1 


METHOD:  EXPERIMENT  1 

At  the  time  the  data  were  collected  a  set  of  windscreens  was  not  available.  Instead  of  real  windscreens,  a  set  of  1 1  flat  Plexiglas* 
panels  that  had  been  fabricated  to  contain  optical  distortions  ranging  from  very  little  to  considerable  was  used.  Keep  in  mind 
that  the  range  of  distortion  used  influences  the  data,  and  that  a  smaller  range  would  lead  to  lower  correlations  than  were 
obtained. 

Clossy  8  by  10  inch  photographic  enlargements  were  made  from  a  35  mm  negative  taken  of  a  grid  board  through  each  of  the 
eleven  panels.  The  set-up  for  taking  the  pictures  is  shown  in  figure  1.  The  panels  were  sloped  at  an  angle  of  49s  to  the  camera's 
line  of  sight.  Figures  5  and  6  are  gridboards  photographed  through  low  and  high  distortion  panels,  respectively.  Two  sets  of  35 
mm  negatives  were  also  taken  through  each  distortion  panel  of  squarewave,  Le.,  parellel  stripe,  targets.  One  set  was  taken  with  a 
vertical  line  target  with  each  distortion  panel  and  one  with  a  horizontal  line  target  The  two  sets  of  square-wave  target  pictures 
were  used  as  the  input  to  the  optical  Fourier  analysis  device  shown  in  figure  2.  A  35  mm  photographic  film  was  exposed  in  the 
Fourier  transform  plane  by  illuminating  the  photographic  negative  with  an  argon  laser.  Clossy  8  by  10  inch  photographic 
enlargements  were  made  from  the  developed  film.  Figures  7  and  8  are  Fourier  pictures  made  through  the  same  distortion  panels 
used  in  taking  the  gridboard  pictures  of  figures  5  and  6. 

The  grid  photographs  were  “shuffled”  like  a  deck  of  cards  each  time  before  being  handed  to  test  subjects  to  obtain  a  random 
order  or  presentation.  The  instruction  sheet  said:  “Arrange  these  pictures  from  the  one  that  has  the  least  distortion  to  the  one 
that  has  the  most.”  The  task  of  arranging  the  Fourier  vertical  line  target  photographs  from  the  one  with  the  most  compact  third 
harmonic  to  the  one  with  the  least  compact  or  most  spread  or  smeared  third  harmonic  was  similarly  done  with  a  “deck”  of  1 1 
pictures  that  were  also  randomly  shuffled  for  each  rater  or  subject.  The  instructions  were:  “Arrange  thesp  pictures  from  best  to 
worst,  best  meaning  having  the  smallest  or  most  tightly  packed  third  harmonic.  The  third  harmonic  is  the  third  light  patch  out 
from  the  central  dot.  Use  the  patch  marked  with  an  arrow  in  making  judgments.”  There  were  two  sets  of  1 1  Fourier  pictures,  one 
for  vertical  frequencies  which  was  made  using  vertical  lines.  Each  set  of  pictures  was  ranked  separately.  No  questions  were 
answered  nor  hints  given  by  the  test  administrator  on  how  to  rank  any  one  of  the  three  sets  of  pictures.  Test  subjects  had  only 
the  instruction  to  go  by.  Twenty-three  raters  ranked  the  grid  pictures  and  the  Fourier  pictures. 

RESULTS:  EXPERIMENT  1 

Table  2  lists  the  ranking  data  for  23  raters  or  test  subjects  for  the  1 1  transparent  distortion  panels.  The  ranks  are  summed  in  the 
“Sum”  column,  for  all  23  raters  for  each  panel,  and  the  sums  of  ranks  are  then  ranked.  This  yields  an  overall  ranking,  or  rank¬ 
ing  over  all  observers,  for  each  panel.  This  overall  ranking  is  listed  in  the  column  labeled  “Rank”  at  the  left  of  the  table.  The 
ranks  for  the  horizontal  and  the  vertical  Fourier  are  averaged  to  obtain  a  Fourier  or  “F”  in  the  table.  The  overall  rank  of  each 
distortion  panel  for  the  gridboard  (G),  the  horizontal  (H)  and  vertical  (V)  Fourier  ranks  and  the  Fourier  [F  or  bi  (H  +  V)]  are 
listed  in  the  column  labeled  “Rank”  at  the  left  of  the  table.  The  overall  rankings  are  also  listed  vertically  by  type  in  table  3,  to 
simplify  comparisons.  The  optical  distortion  ranks  of  the  gridboards  are  plotted  against  the  horizontal  and  the  vertical  Fourier 
compactness  ranks,  respectively,  in  the  scatter  plots  or  diagrams  of  Figure  9. 


The  scatter  plots  inFigure9clearly  showthat  the  two  sets  of  data  are  closely  related.  A  high,  medium  or  low  rating  of  a  panel  on  a 
grid  photograph  goes  with  a  high,  medium,  or  low  rating,  respectively,  on  the  corresponding  vertical  or  horizontal  Fourier  pic¬ 
ture.  From  the  table  it  appears  that  Fourier  picture  compactness  ranks  are  fairly  efficient  predictors  of  the  optical  distortion 
ranks  of  the  gridboard  pictures.  The  relationship  apparent  from  examination  of  tables  2  and  3  are  verified  in  table  4,  which  lists 
some  correlations  between  sets  of  ranks. 

From  tableS,  note  that  the  rank  correlation  coefficient,  r’,  between  Fourier  compactness  rank  for  the  horizontal  Fourier  pictures 
(H)  and  the  gridboard  optical  distortion  rank  (G)  is  .6818.  For  the  vertical  Fourier  pictures  the  r’  is  .8818.  Both  of  these  values  are 
statistically  significant  (P  <  .01).  It  is  concluded  from  this  that  the  obtained  correlations  are  not  attributable  to  chance:  the  rela¬ 
tionships  between  G  and  H  and  between  G  and  V  are  real  and  appreciable  in  size.  The  Fourier  pictures  can  be  used  to  predict 
optical  distortion.  The  vertical  Fourier  ranks  are  more  efficient  predictors  of  optical  distortion  than  are  the  horizontal  ranks. 

The  ranks  on  the  horizontal  and  vertical  Fourier  judgements  of  a  transparency  can  differ  appreciably,  as  is  the  case  with  distor¬ 
tion  Panel  8.  How  closely  are  horizontal  and  vertical  Fourier  compactness  rankings  related?  The  rank  correlation  coefficient,  r*, 
between  the  two  sets  of  ranks  for  the  1 1  distortion  panels  is  +  .5818.  For  a  sample  size  of  1 1  panels  this  is  not  statistically  signifi¬ 
cant  at  the  .05  level  of  significance.  If  Panel  8  is  omitted,  r’  goes  up  to  +  .7697.  However,  one  must  conclude  that  the  data  for  all 
1 1  distortion  panels  indicate  that  the  horizontal  and  vertical  Fourier  compactness  rankings  are  independent:  neither  is  predic¬ 
table  from  the  other. 

It  was  found  that  G  and  V  were  significantly  related  and,  if  Panel  8  were  to  be  omitted,  G  and  H  were  also  significantly  related.  It 
might  be  worthwhile  to  use  both  horizontal  and  veritical  Fourier  ranks  for  predicting  G.  In  table  1  the  numbers  in  the  “F"  row 
are  the  averages  of  H  and  V,  i.e., 
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(A)  Vertical  Fourier  Using  A  Horizontal  Line  Target 


(B)  Horizontal  Fourier  Using  a  Vertical  Line  Target 


Figure  7.  Fourier  pictures  using  the  same  low  distortion  transparent  panel  used  in 
making  the  picture  shown  in  Figure  5.  Only  the  central  component  and  harmonics 
on  one  side  of  it  are  shown. 


(A)  Vertical  Fourier  Using  A  Horizontal  Line  Target 
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(B)  Horizontal  Fourier  Using  a  Vertical  Line  Target 


Figure  8.  Fourier  pictures  using  the  same  high  distortion  transparent  panel  used  in 
making  the  picture  shown  in  Figure  6.  Only  the  central  component  and  harmonics 
on  one  side  of  it  are  shown. 


TABLE  2 


RANKINGS  OF  GRIDBOARD  PHOTOGRAPHS  FOR  DISTORTION  AND  RANKINGS 
OF  FOURIER  PHOTOGRAPHS  FOR  COMPACTNESS  OF  THE  THIRD  HARMONIC 
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H  -  COMPACTNESS  RANK  OF  HORIZONTAL  FOURIER  PICTURES 


Figure  9.  Plot*  of  gridboard  distortion  ratings  against  compactness  rankings  of  the  horisontal  and 
monk  pktures. 
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TABLE  3 


RANKS  OF  CRIOBOARD  AND  FOURIER  PHOTOGRAPHS 
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TABLE  4 

CORRELATIONS  BETWEEN  SETS*  OF  RANK1NCS  MADE  BY  23  RATERS 


RANK  CORRELATION  COEFFICIENT 


CORRELATED  DATA  SETS  ALL  PANELS  No.  B  OMITTED  * 


HV 

(Harts  FourterMVerl.  Fourier) 
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F  -  (H  +  Vy2.  The  r*  between  the  average  Fourier  rank,  F,  and  the  (rid board  photograph  diatortion  rank,  C,  is  .9000,  which  is 
large  and  statistically  significant  (P  <  .01).  However,  the  r’  between  G  and  V  alone  was  .8818,  so  that  the  gain  in  r’  by  using  both 
the  horiiontal  and  vertical  Fourier  is  negligible.  Note,  however,  that  if  Panel  8  is  omitted,  the  r*  goes  up  to  a-  .9679,  which  is  a 
very  large  correlation  coefficient 

Since,  for  all  1 1  panels,  the  vertical  ranks  correlated  higher  than  the  borisontal  ranks  with  gridboard  distortion  ranks,  one  would 
expect  that  in  a  Fourier  composite  rank,  the  weighting  of  the  vertical  ranks  should  exceed  that  of  the  borisontal  ranks.  When 
simply  averaged,  as  in  the  previous  paragraph,  weightings  were  equal.  Let  the  maibaum  Fourier -gridboard  picture  correlation 
achievable  by  a  linear  weighting  of  H  and  V  be  gives  by  the  equation  F  »  AH  +  BV.  It  can  be  shown,  by  a  least  squares 
statistical  technique,  that  the  equation  is  F  »  -2S98H  +  ,7381V.  Note  that  B/A  »  2.8,  so  that  the  optimum  weighting,  B,  of  the 
vertical  Fourier  ranks  in  the  optimum  composite  Fourier  rank  is  almost  three  timet  that  of  the  borisontal  rank  weight,  A.  When 
the  optimum  composite  F  values  gives  by  the  formula  are  used  for  all  11  distrrtion  panels,  the  Fouricr-yidboard  distortion  (F-C) 
rank  correlation  coefficient  is  a  surprising  .9894.  This  is  an  appreciable  gain  over  the  .9000  given  by  limply  averaging  the 


Fourier  rank*  to  predict  the  grid  board  optical  distortion  ranks.  A  correlation  coefficient,!'',  of  .9694  is  extremely  high.  It  is  so 
high  that  one  could  hardly  expect  an  increase  by  omitting  the  data  for  Panel  8.  When  Panel  8  is  omitted  and  the  sums  of  ranks 
are  reranked,  the  new  optimum  weighting  formula  becomes  F  =  .4T77H  +  .5303V,  with  H  and  V  having  similar 
“weightings.”  The  r’  between  weighted  Fourier  compactness  rank  and  grid  board  optical  distortion  rank  with  Panel  8  omitted  is 
.9791,  a  sight  loss  in  r’  value  from  using  all  1 1  distortion  panels,  but  nonthelesa,  still  a  very  high  correlation.  Clearly,  weighting  V 
and  H  differently  in  a  composite  results  in  a  significant  and  important  gain  in  accuracy  as  compared  to  an  equal  weight  (averag¬ 
ing)  composite  or  to  use  of  the  vertical  Fourier  alone. 

As  a  matter  of  interest,  note  on  the  bottom  scatter  plot  of  figure  9  that  optical  distortion  Panel  8  is  a  deviant  point  It  is  located 
some  distance  away  from  the  equal  ranks  straight  line  shown  in  the  figure.  Distortion  Panel  8  was  ranked  high  on  horisontal 
Fourier  compactness  and  low  on  vertical  Fourier  compactness.  Panel  8  had  the  largest  H-V  difference  of  any  of  the  1 1  panels. 
Both  H  and  V  are  related  to  gridboard  photograph  distortion  rank.  Since  8  was  a  deviant  point,  the  excluaion  of  Panel  8  data 
resulted  in  an  appreciable  increase  in  the  size  of  the  G-H  correlation  coefficient  If  the  sums  of  the  ranks  of  table  1  are  ranked 
without  using  the  data  for  distortion  Panel  8,  the  value  of  r'  increases  from  .6818  to  .9152.  The  scatter  plot  of  the  reranked  data 
is  shown  in  figure  10. 

It  is  apparent  that  an  occasional  panel  or  windscreen  will  be  found  whose  optical  distortion  is  not  predictable  with  any  useful  ac¬ 
curacy  from  its  horizontal  Fourier  picture.  One  can  only  conjecture  that  occurrence  of  an  occasional  panel  which  may  be  much 
more  distorting  in  the  horizontal  than  in  the  vertical  direction,  or  vice  versa,  is  to  be  expected.  As  a  further  point  of  interest,  it 
has  been  found  in  the  past,  by  aircraft  windscreen  manufacturers,  that  an  occasional  windscreen  that  failed  to  meet  Air  Force 
contractual  requirements  for  magnification  and  optical  deviation  was  judged  by  windscreen  inspectors  and  by  aircraft  pilots  as 
appearing  to  be  optically  satisfactory.  In  these  cases  it  appears  that  slow  changes  over  a  windscreen  surface,  in  magnification 
and  in  deviation,may  be  judged  as  satisfactory  even  if  the  two  values  become  appreciable  in  magnitude. 


Figure  10.  Distortion  ranks  of  gridboard  photographs  plotted  against  compactness  ranks  of  horizontal  Fourier  pictures  with 
picture  “8”  omitted. 
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In  previous  paragraphs  concern  has  focused  on  correlations  between  averages  over  all  raters.  Some  r’  values  for  the  23  in¬ 
dividual  raters  are  listed  in  table  S.  The  “Max  r’  ’*  column  to  the  right  of  the  table  lists  the  largest  r’  values  for  the  rater  in  the 
row.  The  following  points  may  be  noted  from  examination  of  the  table: 

•  Of  the  23“Max  r*”  values,  13  are  for  G-V  correlations  and  10  are  G-F. 

•  Only  1  maximum  value  is  in  the  H-V  column.  It  is  for  rater  10.  He  has  the  largest  r'  value  in  the  H-V  column,  but  also  the 
lowest  r’  value  in  the  C-F  column. 

•  For  18  of  the  23  raters  the  G-V  correlation  exceeded  the  G-H  correlation.  Thus,  for  78%  of  the  raters  their  gridboard 
photograph  distortion  ranking  (G)  was  predicted  (or  measured)  more  efficiently  by  their  vertical  Fourier  rank  (V)  than  by 
their  horizontal  Fourier  rank  (H). 

•  The  largest  r*  in  the  entire  table  was  in  the  C-V  column:  a  .945  for  rater  3. 


TABLE  5 

RANK  CORRELATION  COEFFICIENTS  BETWEEN  DISTORTION  RANK  OF  GRID  PHOTOGRAPHS  AND  COMPACT¬ 
NESS  RANK  FOR  FOURIER  PICTURES 


(HORIZONTAL)- 

(GRID  PHOTON 

(GRID  PHOTO) 

(GRID  PHOTO) 

RATER 

(VERTICAL) 

(HORIZONTAL) 

(VERTICAL) 

(FOURIER) 

'HV 

rC-H 

'c-v 

'CF 

MAX  r’ 

1 

+  .673 

+  .691 

+  .855 

♦  557 

C-F 

2 

+  .736 

+  .736 

+  .900 

+  507 

C-V 

3 

+*655 

+  .691 

+  .945 

+  .900 

C-V 

4 

+  .591 

+  .664 

+  509 

+  532 

C-F 

5 

+  .682 

+  .645 

+  .909 

+  564 

C-V 

6 

+  .582 

+  .745 

+  .836 

+  568 

CF 

7 

+  .609 

+  582 

+  536 

+  .77 0 

C-V 

8 

+  .536 

+  536 

+  555 

+  .736 

c-v 

9 

+  .564 

+  .709 

+  .718 

+  .773 

CF 

10 

+  .936 

+  527 

+  .464 

+  .450 

HV 

II 

+  .600 

+  .609 

♦  527 

♦  509 

C-V 

12 

+  .518 

+  .691 

+  .736 

♦  534 

C-F 

13 

+  .491 

+  .627 

♦  518 

+  .643 

G-F 

14 

+  .491 

+  .791 

+  .782 

+  .920 

CF 

15 

+  .577 

+  .591 

+  .855 

+  509 

CV 

16 

+  .418 

+  .436 

+  555 

+  .716 

C-V 

17 

♦  .509 

+  .382 

♦  591 

♦  70S 

CV 

18 

+.627 

+  .518 

+  .918 

+  .789 

CV 

19 

+  .426 

+  .691 

+  .645 

+  .777 

C-F 

20 

+  .618 

+  545 

+  .700 

+  543 

C-F 

21 

+  .418 

+  .655 

+  .727 

+  536 

C-F 

22 

+  .709 

♦  527 

+  .745 

+  .707 

C-V 

23 

+  .609 

+  .482 

+  .691 

+  .627 

C-V 

MEDIAN 

591 

.645 

527 

J07 

c-v 

MEAN" 

611 

.645 

510 

.794 

Fourier,  h ere, '»  the  rank  of  (he  mum  of  rank*  for  the  homontal  and  vertical  foarier  picture*.  It  ■  noi  the  average  of  the  homontal  and  vertical  rank*. 


The  proper  mean  of  a  group  of  correlation  coefficient*  it  not  the  arithmetic  mean,  but  »  calculated,  here,  by  taking  the  inverae  hyperbolic  tangent  of  each  r*  in  the 
column,  mi  mm  mg  all  23,  dividing  by  23  and  taking  the  hyperbolic  tangent  of  thw  quantity.  Note  (hat  the  value*  are  very  cto*e  to  the  median*. 


•  As  expected,  the  mean  and  median  values  at  the  bottom  of  the  table  show  that  the  vertical  Fourier  is  better  than  the  horizon¬ 
tal  for  predicting  the  distortion  rank  of  a  gridboard  photograph. 

•  Also,  the  C-V  mean  of  .810  was,  for  all  practical  purposes,  the  same  as  the  C-F  mean  of  .794,  while  the  G-V  median  of  .827 
exceeded  the  .807  G-F  median. 

The  individual  rater  correlations,  as  expected,  support  the  findings  Grom  the  group  averages: 

•  Fourier  compactness  can  be  used  to  measure  optical  distortion. 

•  The  vertical  Fourier  compactness  values  are  more  efficient  for  predicting  or  measuring  optical  distortion  than  are  the 
horizontal  Fourier  values. 

•  A  simple  average  (or  equal  weight  composite)  of  V  and  H  was  no  more  efficient  than  the  vertical  values  alone.  An  unequal 
weight  composite  Fourier  is  required. 
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EXPERIMENT  2 


In  the  first  experiment,  the  authors  of  this  study  as  well  as  the  picture  raters  noted  that  some  of  the  pictures  were  very  similar  to 
others  in  amount  of  distortion  or  in  amount  of  compactness  of  the  third  harmonic.  Such  pictures  were  not  easily  ranked  in  the 
series.  In  other  words,  the  spacing  of  each  quantity  being  ranked  was  not  uniform.  In  making  only  the  ordering  or  sequencing 
judgments  required  to  rank  pictures,  as  was  done  in  Experiment  1,  no  spacing  information  is  obtained.  It  might  be  conjectured 
that,  had  estimates  of  magnitude,  rather  than  only  ranks,  been  obtained,  correlations  between  quantities  would  increase.  A  sec¬ 
ond  experiment  was  done  to  examine  this  possibility. 

An  experimental  method  that  yields  measurement  rather  than  ordering  or  ranking  was  desired.  The  method  of  magnitude 
estimation,  although  it  is  subjective,  is  such  a  method.  In  this  method  the  rater  compares  each  test  picture  to  a  standard  picture 
and  assigns  a  number  to  the  test  picture.  The  standard  picture  in  the  present  study  was  assigned  a  value  of  5  on  a  scale  ranging 
from  1  to  10.  On  the  scale,  1  represented  a  perfect  picture.  The  instructions  to  the  raters  in  Experiment  2  were  typed  and  were 
handed  to  the  raters  to  study  before  taking  data.  The  instructions  are  given  in  Appendix  I  of  this  report.  Ten  raters,  working  in¬ 
dependently,  first  ranked  the  1 1  grid  photographs  from  best  or  least  optical  distortion  to  worst  or  most  distortion.  They  then 
estimated  the  magnitude  of  the  optical  distortion  of  each  picture  as  compared  to  the  one  that,  after  ranking  was  completed,  was 
labeled  by  the  test  administrator  as  a  “5.” 

In  a  similar  manner,  they  first  ranked,  then  estimated  the  magnitude  of  the,  compactness  of  the  third  harmonic  of  the 
horizontal  Fourier  pictures.  They  then  ranked  and  magnitude  estimated  the  vertical  Fourier  pictures.  The  picture  that  had 
a  5  label  attached  to  it  was  the  photograph  taken  through  distortion  panel  3  for  both  the  gridboard  pictures  and  the 
horizontal  Fourier  pictures.  For  the  vertical  Fourier  pictures,  the  standard  was  the  one  taken  through  distortion  panel  13. 
These  particular  pictures  appeared  to  the  test  administrator  to  be  at  approximately  5  on  an  estimation  scale  ranging  from  I 
to  10.  Only  after  each  observer  ranked  all  of  the  pictures  was  he  informed  which  picture  was  the  standard  or  “5”  picture 
so  that  he  could  then  do  the  magnitude  estimation  task. 


RESULTS:  EXPERIMENT  2 

The  data  from  the  second  experiment  are  presented  in  tables  6, 7  and  8.  Note  the  small  variability  between  raters,  as  evidenced 
by  the  table  entries  and  by  the  column  of  standard  deviations  (S.D.'^tn  each  table.  This  rather  small  scatter  or  variability  is 
found  for  both  the  ranking  data  and  the  magnitude  estimation  data.  The  majority  of  all  judgments  of  a  given  type  on  a  particular 
distortion  panel  appear  to  be  in  rather  close  agreement. 

The  first  question  that  may  occur  to  the  reader  is  “How  closely  do  the  rankings  and  the  magnitude  estimations  agree?”  Keep  in 
mind  that  the  pictures  were  first  ranked,  then  the  magnitude  of  the  quantity  of  interest,  relative  to  the  standard,  was  estimated. 
The  estimates  took  place  with  the  pictures  still  in  the  order  in  which  they  were  ranked  by  the  rater.  This  procedure  made  the  rank¬ 
ings  and  the  magnitude  estimates  agree  in  rank  and  increased  the  correlation  between  rankings  and  estimations.  Thus,  the  data 
do  not  reveal  how  closely  the  ranks  and  magnitude  estimates  would  agree  if  the  estimates  had  been  made  with  unranked  or  ran¬ 
domly  arranged  pictures.  Table  9  gives  the  correlation  coefficients  for  the  ranking  and  magnitude  estimation  data  of  individual 
observers.  From  the  table  it  may  be  noted  that  the  correlations  are  quite  high.  The  mediums  at  the  bottom  of  the  table  indicate 
that  the  ratings  of  most  individuals  are  in  good  agreement.  A*  expected,  there  is  excellent  agreement  between  rankings  and 
magnitude  estimates.  Note  also  the  generally  higer  r'  values  in  the  vertical  Fourier  column  as  compared  to  the  horizontal 
Fourier  column.  Nine  of  the  10  vertical  values  exceed  the  horizontal  ones,  and  the  median  vertical  r’  is  .876  as  compared  to  .790 
for  the  horizontal. 

The  relationship  between  magnitude  estimates  for  the  three  sets  of  pictures  are  given  for  individual  observers  in  table  10.  In  all 
three  columns  the  correlation  coefficients  are  quite  high.  Compare  the  size  of  the  medians  at  the  bottom  of  the  table.  They  in¬ 
dicate  that  the  “compactness"  estimates  for  both  the  vertical  and  the  horizontal  Fourier  pictures  are  highly  correlated  with  the 
distortion  estimates  made  of  the  gridboard  photographs.  The  data  also  show  that  the  horizontal  and  vertical  estimates  are  almost 
as  closely  correlated  with  each  other  (.77 1 )  as  either  one  is  correlated  with  the  gridboard  distortion  estimates.  The  medians  at  the 
bottoms  of  the  first  two  columns  of  table  10  are  essentially  equal:  .810  versus  .790.  For  individual  observers,  the  horizontal  and 
vertical  harmonic  compactness  estimates  appear  to  be  essentially  equal  in  the  efficiency  with  which  they  predict  optical  distor¬ 
tion  estimates.  Later  in  this  report  it  is  shown  that  this  equivalence  does  not  hold  for  the  averages  of  groups  of  individuals. 

In  tables  4, 5  and  6,  for  each  distortion  panel  or  windscreen,  there  is  an  average  value  across  all  10  raters.  These  sets  of  averages 
can  be  used  to  calculate  correlation  coefficients  whose  magnitudes  will  enable  one  to  compare  the  magnitude  estimation  method 
r  ,th  the  ranking  method  for  efficiency  in  predicting  judged  optical  distortion.  These  correlations  between  averages  for  the 
istorthm  panels  are  given  in  table  1 1.  Note  the  very  high  statistically  significant  (P  <  .01)  correlation  of  .9773  between  the  rank¬ 
ings  and  the  magnitude  estimations  of  the  optical  distortion  of  the  gridboard  photographs.  The  reason  for  such  a  high  correla¬ 
tion  is  due,  in  part,  to  the  already  mentioned  experimental  procedure  where  estimates  where  made  while  the  pictures  were  in  the 
order  in  which  they  were  ranked  by  the  person  making  the  estimation. 
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TABLE  6 


|  (B)  MAGNITUDE  ESTIMATION 

i 


(A)  RANKING 


1 1  IP 


TABLE  7 

COMPACTNESS  OF  HORIZONTAL  FOURIER  THIRD  HARMONIC 


j 


i 

1 

} 

i 

j 

I 


Rater  or 

Test  Subject 

Average  S.D. 

=  15 

Panel 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

Mean 

MDN 

Mode 

S.  D. 

1 

5 

5 

5 

2 

5 

4 

6 

2 

5 

5 

4.40 

5.83 

5 

1.35 

2 

4 

4 

3 

5 

4 

5 

3 

3 

4 

4 

3.90 

3.90 

4 

.74 

3 

6 

6 

6 

8 

7 

7 

i 

7 

6 

7 

6.10 

650 

65** 

1.91 

4 

11 

10 

10 

11 

11 

10 

10 

9 

10 

11 

10.30 

10.30 

10 

.67 

5 

8 

8 

0 

0 

8 

8 

7 

8 

8 

9 

8.20 

8.17 

8 

.63 

8 

9 

0 

7 

4 

6 

9 

9 

11 

9 

6 

7.90 

8.70 

9 

2.08 

9 

2 

1 

4 

6 

1 

2 

5 

5 

3 

3 

3.20 

3.00 

2* 

1.75 

10 

1 

2 

2 

3 

2 

1 

4 

1 

1 

1 

1.50 

1 

1.03 

11 

10 

11 

11 

10 

10 

11 

11 

10 

II 

10 

10.50 

10.50 

10.5 

53 

13 

3 

3 

1 

1 

3 

3 

2 

4 

2 

2 

2.40 

2.50 

3 

.97 

15 

; 

7 

8 

7 

0 

6 

8 

6 

7 

8 

7.30 

7.25 

7 

.95 

(B)  MAGNITUDE  ESTIMATION 

Rater  or 

Test  Subject 

Average  S.D. 

=  1.02 

Panel 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

Mean  + 

MDN 

Mode 

S.  D. 

l 

4.7 

4.0 

4.2 

3.0 

4.5 

3.5 

6.5 

2.5 

4.5 

4.4 

4.05 

4.30 

4.5 

1.09 

2 

4.5 

n 

3.0 

3.8 

4.0 

4.5 

5.2 

3.0 

4.2 

4.2 

3.95 

4.10 

4.10** 

.68 

\ 

0.2 

7.0 

8.0 

6.5 

8.5 

6.4 

9.0 

6.0 

8.0 

6.8 

7.46 

7.50 

8 

1.15 

5 

5.8 

6.0 

7.1 

5.5 

5.5 

5.3 

7.0 

5.3 

6.5 

5.7 

5.94 

5.75 

5.40* 

.67 

K 

7.0 

6.3 

6.2 

3.7 

4.7 

6.0 

8.0 

9.0 

7.5 

4.8 

6.12 

6.25 

6.25 

1.63 

9 

3.5 

3.0 

3.2 

1.0 

3.0 

28 

6.0 

40 

3.5 

39 

3.60 

3.50 

3.5 

.92 

10 

3.0 

3.3 

2.2 

3.5 

3.2 

2.3 

S3 

20 

25 

3.5 

2.96 

3.10 

35 

.96 

II 

8.0 

8.2 

8.4 

6.0 

7.0 

6.5 

9  1 

7.0 

90 

6.2 

7.54 

7.65 

7 

1.22 

13 

3.0 

3.4 

1.8 

2.5 

35 

3.2 

5.1 

35 

3.0 

3.7 

3.25 

3.45 

3.5 

.87 

15 

5.4 

5.7 

6.7 

4.5 

6.5 

4.8 

75 

4.5 

6.0 

5.5 

563 

5.60 

4.5 

.99 

♦  For  magnitude  estimation  the  geometric  mean  is  used. 

•  When  dual  modes  orrur,  the  value  given  is  midway  between  the  two  groupings. 
**  When  no  mode  is  present,  the  value  is  the  median. 
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NOTE:  Panel  3  was  the  standard,  henre  it  is  not  in  table  (B). 


TABLE  8 


COMPACTNESS  OF  VERTICAL  FOURIER  THIRD  HARMONIC 

(A)  RANKINC 


Rater  or 

Test  Subject 

Average  S.D. 

-  98 

Panel 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

Mean 

MDN 

Mode 

S  D 

l 

1 

1 

> 

6 

1 

1 

1 

> 

> 

1 

1.50 

1.06 

• 

1.35 

2 

2 

2 

2 

4 

7 

2 

2 

2 

2 

2 

2.70 

2  12 

2 

1  64 

3 

8 

8 

9 

9 

9 

9 

8 

9 

8 

8 

8.50 

8.50 

85" 

.53 

I 

11 

10 

10 

11 

11 

10 

11 

10 

9 

10 

10.30 

10.30 

10 

.67 

5 

9 

9 

8 

8 

8 

8 

9 

8 

10 

9 

8.60 

6.50 

8 

70 

8 

5 

4 

4 

■ 

3 

3 

4 

6 

5 

4 

3.90 

4.00 

4 

137 

9 

6 

7 

6 

5 

5 

7 

7 

7 

7 

7 

6.40 

6.67 

7 

84 

10 

3 

3 

3 

2 

2 

4 

3 

5 

4 

3 

3.20 

3  10 

3 

92 

11 

10 

11 

11 

10 

10 

11 

10 

11 

11 

II 

(0.60 

1067 

11 

52 

13 

4 

5 

5 

3 

4 

6 

5 

3 

3 

5 

4.30 

4.50 

5 

1.06 

15 

7 

6 

7 

7 

6 

5 

6 

4 

6 

6 

6.00 

6.10 

6 

.94 

(B)  MAGNITUDE  ESTIMATION 


Rater  or 

Test  Subject 

Average  S.D. 

.79 

Panel 

24 

25 

26 

27 

28 

29 

30 

31 

32 

33 

Mean  * 

MDN 

Mode 

S.  D 

1 

3.0 

2.0 

1.8 

6.5 

2.0 

3.3 

2.5 

3.0 

2.5 

4.0 

2.85 

2.75 

2.50* 

1.38 

2 

4.5 

3.0 

2.8 

55 

3.0 

4.0 

3.5 

4.3 

3.93 

3.85 

3 

1.16 

3 

7.5 

6.5 

7.7 

8.0 

7.8 

6.5 

7.0 

75 

8.0 

75 

7.38 

7.50 

75 

56 

4 

9.6 

8.0 

8.2 

9.0 

9.0 

7.1 

8.0 

8.5 

8.7 

8.4 

8.42 

8.45 

8.50* 

69 

5 

8.0 

7.5 

7.5 

7.5 

7.0 

6.1 

75 

7.0 

9.0 

8.1 

7.48 

7.50 

75 

.77 

8 

5.3 

3.8 

4.7 

4.5 

4.0 

45 

6.0 

5.5 

4.6 

4.58 

455 

45 

.78 

9 

7.0 

6.0 

5.7 

6.0 

5.8 

55 

6.0 

6.2 

75 

5.7 

6.15 

5.97 

6 

.60 

10 

4.6 

3.5 

4.1 

4.0 

4.2 

4.3 

4.4 

5.7 

5.3 

4.4 

4.43 

4.35 

cM 

.64 

11 

9.3 

8.2 

9.0 

8.5 

8.3 

75 

7.7 

9.0 

95 

85 

8.53 

850 

8.75* 

.66 

15 

6.1 

5.3 

6.4 

6.8 

6.3 

4.7 

5.2 

55 

6.0 

5.3 

5.73 

5.75 

S3 

.66 

f  For  mtgnitudr  nlimiiion  ibr  uromrlrir  mean  m  used. 

•  Whan  dual  mode*  occur,  the  value  gfiven  u  midway  between  the  two  groupings. 
••  When  no  mode  is  present,  the  value  is  the  median. 
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NOTE:  Panel  3  was  the  standard,  hence  it  is  not  in  table  (B). 


TABLE  9 


CORRELATIONS  BETWEEN  RANKINGS  AND  MAGNITUDE  ESTIMATES 


SPEARMAN  RANK  CORRELATION  COEFFICIENT 

OBSERVER 

CRID  PHOTOGRAPHS 

HORIZONTAL  FOURIER 

VERTICAL  FOURIER 

24 

806 

559 

584 

25 

.767 

.777 

578 

26 

.936*  • 

■887* 

.924 

27 

.833 

.604** 

571 

28 

.839 

.786 

588 

29 

.682 

.674 

.750” 

30 

736 

.859 

.795 

31 

.815 

.794 

573 

32 

jbsr* 

.871 

.939* 

33 

5M 

.700 

526 

MEDIAN  ♦ 

.810 

.790 

576 

*  Maximum  value  in  the  column  of  numbers 
”  Minimum  value  in  the  column  of  numbers 

♦  Half  of  all  values  exceed  and  half  are  less  than  the  median  in  the  columns  of  the  table. 

TABLE  10 

CORRELATIONS  BETWEEN  MAGNITUDE  ESTIMATIONS 

SPEARMAN  RANK  CORRELATION  COEFFICIENT 

OBSERVER 

GRID  PHOTO.  & 

HORIZ  FOURIER 

GRID  PHOTO.  ft 

VERT  FOURIER 

HORIZONTAL  FOURIER  ft 

VERTICAL  FOURIER 

24 

.848 

.744 

.751 

25 

.889* 

.920 

.968* 

26 

.768 

.903 

545 

27 

.871 

.674 

.656 

28 

.836 

.582 

.791 

29 

m 

529 

535 

30 

554” 

.921* 

.647 

31 

■70S 

.695 

.642” 

32 

.627 

.407” 

.672 

33 

mn 

569 

RSI 

MEDIAN  ‘ 

519 

.786 

.771 

*  Maximum  value  in  the  column 

••  Minimum  reive  in  the  column  of  numbers 

*  Hair  of  all  value*  exceed  and  half  are  let*  than  the  median  in  the  column*  of  the  table. 
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Note  the  correlations  in  table  1 1  of  ranks  of  grid  photographs  for  distortion  with  ranks  of  horizontal  Fourier  pictures 
(.6745)  and  the  r’  of  .0169  of  magnitude  estimations  of  grid  photograph  distortion  with  magnitude  estimations  of  horizontal 
Fourier  compactness.  This  latter  value  of  .0169  is  not  significantly  different  from  zero.  Clearly,  the  magnitude  estimates 
were  inferior  to  the  ranks  of  third  harmonic  compactness  for  predicting  the  judged  optical  distortion  in  the  gridboard 
photographs.  The  corresponding  correlations  of  .9504  for  ranks  and  .1376  for  magnitude  estimations  for  the  horizontal 
Fourier  indicate  that  the  same  superiority  of  the  ranks  over  the  estimates  hold  for  the  vertical  Fourier  pictures.  Rankings 
were  appreciably  better  than  magnitude  estimations  in  predicting  gridboard  photograph  distortion  from  either  horizontal  or 
vertical  Fourier  photographs.  The  expectation,  before  data  collection,  was  that  estimations  might  be  superior  to  ranks.  If 
the  raters  had  been  trained  in  making  magnitude  estimation  judgments,  the  correlations  might  have  been  higher,  but  this  is 
only  conjecture. 


TABLE  11 

CORRELATIONS  BETWEEN  RATER  AVERAGES 


Gridboard  Photographs 

Compactness  of  Fourier  Third  Harmonic 

Distortion  Rankings 

Distortion  Estimations 

Ranking, 

Horisontal 

Vertical 

Horisontal 

Vertical 

Measure 

H 

V 

H 

V 

Estimations  .9773(10) 

•80)8(10) 

.9656(10) 

.0169(9) 

.1364(9) 

Rankings 

.6745(111* 

.9504(1 1)+ 

.78SS(I0) 

9313(10) 

NOTE:  The  number  in  parenthesis  following  the  correlation  coefficient  is  the  number  of  pairs  of  averages  that  are  used  in  the  compulation  of  the  correlation 
coefficient.  Since  one  ‘'picture'*  is  the  standard  (with  a  value  of  5)  in  the  magnitude  estimations,  and  since  the  standard  is  not  the  same  for  vertical 
and  horitonlal  Fourier  pictures,  the  numbers  in  the  parenthesis  will  vary  from  9  to  II. 

♦  Spearman  rank  correlation  coefficients.  The  other  correlation  coefficient*  in  the  table  are  product  moment  correlation  coefficients. 


TABLE  12 

CORRELATION  OF  FOURIER  COMPACTNESS  DATA  WITH 
DISTORTION  DATA  FROM  GRIDBOARD  PHOTOGRAPHS 


RANKS + 

MAGNITUDE  ESTIMATES  *  ♦ 

c-v 

C-H 

C-F' 

C-F’ 

CV 

G-H 

C-F* 

G-F’ 

.9504 

.6745 

.9349 

.9569 

.1376 

.0169 

.0884 

.0889 

+  The  coefficients  for  ranks  are  Spearman  rank  correlation  coefficients,  based  on  1 1  pairs  of  values. 

♦  +The  coefficients  for  magnitude  estimates  are  produce  moment  correlation  coefficients,  based  on  9  pairs  of  value*. 

•The  value  of  F*  is  (H  +  Vy2,  i.e.,  the  average  of  the  horisontal  and  vertical  Fourier  means  for  each  panel.  The  value  of  F’  is  calculated  for  the 
formula  F*  *  AH  +  BV,  where  A  and  B  are  derived  from  a  least  squares  calculation  giving  the  optimum  Fourier  value  for  maiimiimg  the  G-F 
correlation. 


KEY:C  =  Gridboard;  V  «  Vertical  Fourier;  H  *  Horisontal  Fourier;  F*  *  The  H-V  Average,  F*  -  Optima)  H-V  Composite. 


A  comparison  of  the  compactness  of  the  vertical  Fourier  third  harmonic  with  the  borixontal  Fourier  third  harmonic  for  predic¬ 
ting  distortion  rankings  is  of  some  interest  Note  in  both  the  two  distortion  rankings  columns  and  in  the  two  distortion  estimates 
columns  that  the  vertical  Fourier  column  hu  appreciably  higher  correlation  coefficients  than  the  horisontal  Fourier  column. 

This  is  true  for  all  four  comparisons  in  the  table.  The  vertical  Fourier  photographs  are  more  efficient  than  the  horisontal  Fourier 
photographs  for  either  estimating  or  ranking  judged  grid  photograph  optical  distortion.  This  superiority  of  the  vertical  Fourier 
pictures  was  also  found  in  Experiment  1 . 

One  might  expect  that  since  both  vertical  (V)  and  horisontal  (H)  Fourier  data  were  correlated  with  gridboard  photograph  distor¬ 
tion  (C)  data,  a  composite  of  V  and  C  might  be  superior  to  either  alone.  This  expectation  does  not  work  out  The  basis  for  this 
answer  is  found  in  table  12.  With  the  10  raters  in  experiment  2,  the  rank  data  yield  essentially  equal  correlations  between  C  and 
F  with  either  equal  V-H  weights  (F*)  or  with  optimum  weights  (F’).  Use  of  V  alone  is  essentially  as  good  as  using  a  composite  of  V 
and  H,  and  is  appreciably  better  than  use  of  H  ranks  alone  for  predicting  gridboard  photograph  distortion  rank  (G).  The  same  is 
true  for  magnitude  estimation,  except  that  the  composite  is  essentially  worthless,  being  even  lo  wer  than  V  in  prediction  efficiency. 

CONCLUSIONS  FROM  EXPERIMENTS  1  AND  2 

•  The  subjective  measurements  have  shown  that  optical  Fourier  analysis  can  be  used  with  considerable  effectiveness  to  measure 
the  optical  distortion  of  a  distorting  transparent  panel.  Since  the  Fourier  method  is  effective,  it  would  be  worthwhile  to  develop 
an  objective  method  for  quantifying  the  “compactness”  of  Fourier  harmonics.  This  study  has  shown  that  an  efficient  objective 
optical  qualty  assessment  technique  is  possible. 

•  In  the  present  study  vertical  Fourier  pictures,  i.e.,  pictures  made  with  vertical  parallel  target  lines,  were  more  efficient  than 
horizontal  Fourier  pictures  in  predicting  the  optical  distortion  of  transparent  distorting  panels.  Unequal  but  optimum  weighting 
of  vertical  and  horizontal  Fourier  harmonic  compactness  data  to  attain  a  composite  Fourier  rating  may  not  be  necessary.  Use  of 
only  vertical  Fourier  data  may  be  adequate.  The  use  of  vertical  line  targets  only  will  have  to  be  verified  by  experimentation  with 
real  aircraft  windscreens.  The  decision  should  be  arrived  at  after  an  objective  Fourier  “compactness”  measure  has  been 
developed  and  applied  to  real  windscreens. 

•  Magnitude  estimation  was  decidely  inferior  to  ranking,  especially  when  data  from  several  raters  was  averaged,  for  predicting 
optical  distortion. 


APPENDIX  I 

INSTRUCTIONS  FOR  EXPERIMENT  2 


You  will  be  given  a  set  of  pictures.  Each  picture  shows  several  “blobs”  or  "smeared  out”  areas  of  light  One  of  the  pictures  is  a 
standard  or  anchor  that  defines  the  center  or  “5”  of  a  scale  of  commpactness,  a  scale  that  goes  from  1  to  10.  You  will  have  two 
tasks:  first  to  rank  the  pictures  for  compactness  of  the  arrow-designated  area,  then  to  estimate  the  amount  of  compactness  on  a 
10  point  scale. 

(A)  Task  1:  Ranking  Compactness 

Arrange  these  pictures  from  best  to  worst,  “Best”  meaning  having  the  smallest  or  most  tightly  packed  blob,  and  “Worst”  hav¬ 
ing  the  largest  or  least  tightly  packed  blob.  The  “blob”  that  you  are  to  rank  is  marked  with  an  arrow.  Ignore  the  remainder  of 
the  picture.  When  you  are  finished,  hand  the  stack  of  ordered  or  ranked  pictures  to  the  teat  administrator. 


(B)  Task  2:  Estimating  Amount  of  Compactness 
Introduction 

In  Task  1  you  arranged  the  pictures  in  order.  In  Task  2  you  have  to  assign  a  number  to  each  picture.  The  number  indicates 
where  the  compactness  of  the  designated  area  (or  “blob”)  falls  on  a  scale  of  1  to  10.  When  you  arranged  the  pictures  in  order  in 
Task  1,  you  may  have  noticed  that  the  difference  in  amount  of  distortion  in  adjacent  pictures  varied:  some  pairs  differed  by  little, 
while  others  differed  by  an  easily  noticeable  amount.  Thus,  the  numbers  that  you  assign  to  locate  pictures  on  the  compactness 
scale  are  unlikely  to  be  whole  numbers  such  as  1, 2, 3,  etc.  Numbers,  such  as  1.5, 1.7,  etc.,  are  more  likely.  As  an  example,  if  a  pic¬ 
ture  falls  barely  above  midway  on  the  scale,  it  might  receive  a  5.1  or  5.2  etc. 

Your  Task 

Take  each  picture,  one  at  a  time,  and  place  it  next  to  the  standard  picture.  Examine  both  and  assign  a  number  to  the  unknown 
picture.  This  number  is  the  estimated  degree  of  compactness.  It  indicates  where  the  picture  falls  on  the  1-10  point  scale  whose 
center  is  established  by  the  standard  (or  “5”)  picture.  Hand  the  picture  to  the  test  administrator  and  give  him  your  estimated 
compactness  rating  for  it.  Co  on  to  the  next  picture,  etc. 


APPENDIX  II 

COMMENTS  ON  FOURIER  ANALYSIS 


The  physicist,  the  mathematician  and  the  engineer  are  familiar  with  Fourier  analysis,  as  it  is  a  tool  that  they  frequently  use.  Most 
workers  in  other  disciplines  have  not  encountered  Fourier  analysis.  The  comments  in  this  appendix  are  at  an  elementary  level 
and  are  of  interest  only  to  those  not  familiar  with  the  technique. 

The  basic  notion  of  Fourier  analysis  is  that  any  two-dimensional  figure  may  be  conceived  of  as  consisting  of  a  series  of  sine  waves 
of  different  frequencies,  amplitudes,  and  phases.  Any  figure  may  thus  be  “broken  down*'  or  analyzed  into  a  series  of  such  waves 
and,  conversely,  if  such  a  series  of  sine  waves  is  added  together,  the  original  figure  is  “reconstituted"  or  synthesized.  Pictures, 
even  simple  line  drawings,  contain  an  infinite  number  of  these  sine  waves.  Analyzing  a  real  picture  or  figure  into  sine  wave  com¬ 
ponents  would  be  a  prodigious  task,  even  if  only  a  few  of  the  lower  spatial  frequency  waves  were  broken  out.  Fortunately,  a 
technique  known  as  optical  Fourier  analysis  simultaneously  abstracts  the  sine  waves  over  an  entire  picture.  The  equipment 
shown  in  figure  2  does  this. 

Suppose  that  a  photograph  is  made  of  a  test  pattern  composed  entirely  of  straight  parallel  bars  or  stripes,  with  the  space  between 
bars  being  essentially  black.  If  a  device  for  measuring  light  intensity  in  a  small  area  is  scanned  across  one  stripe,  the  output  of 
the  device  will  jump  from  essentially  zero  to  a  high  value  in  coming  onto  the  stripe  from  one  edge,  remain  constant  across  the 
stripe,  and  fall  to  zero  in  passing  the  second  edge.  A  plot  of  intensity  against  time  or  location  of  the  scan  would  thus  resemble  the 
top  and  sides  of  a  square  or  a  rectangle.  That  is  why  a  target  composed  of  parallel  straight  stripes  is  called  a  square  wave  target. 
The  square  wave  so  produced  in  the  plot  of  the  output  of  the  light  intensity  measuring  device  could  be  synthesized  by  adding 
together  a  large  number  of  the  proper  sine  waves. 

If  an  optical  Fourier  analysis  is  performed  on  the  picture  of  the  parallel  stripe  or  square  wave  target,  there  will  exist  in  the 
Fourier  or  transform  space  a  pattern  of  energy  representing  the  spatial  sine  wave  composition  of  the  target.  Distance  out  from 
the  center  represents  the  frequency.  In  the  center,  there  will  be  a  small  central  spot  or  energy  concentration.  There  also  will  be  a 
series  of  uniformly  spaced  “spots”  at  right  angles  to  the  stripes  in  the  original  picture  of  the  target.  These  secondary  spots 
represent  harmonics  or  multiples  of  the  basic  optical  spatial  frequency  of  the  square  wave  test  target  pattern.  If  the  original 
photographs  were  taken  of  a  parallel  line  pattern  with  an  intervening  windscreen  between  the  camera  and  the  gridboard,  the 
thickness  and  straightness  of  the  lines  in  the  photograph  would  vary.  This  variation  would  cause  variation  in  optical  spatial  fre¬ 
quencies  and  intensities.  It  would  result  in  a  spreading  or  smearing  of  the  energy  in  the  harmonic  “spots.”  The  more  expensive 
the  smearing,  the  greater  the  corresponding  distortion  in  the  windscreen. 
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